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Adaptive Bandwidth Allocation by Wavelet Decomposition and Energy 

Analysis of Network Traffic 

Field of the Invention 

The present invention relates generally to a method or system for allocating 
network resources for data streams, and more particularly to adaptive bandwidth 
5 allocation for bit streams in network QoS management blocks, traffic schedulers 
and routers. 

Background of the Invention 

10 An asynchronous transfer mode (ATM) network provides connection-oriented 
communication services with a guaranteed bandwidth. To carry data in the ATM 
network, a virtual circuit (VC) with a predetermined bandwidth is allocated. An 
adaptation layer of the network protocol keeps the VC open as long as the data rate 
matches the allocated bandwidth, see H. Saran, S. Keshav, "An empirical 

15 Evaluation of Virtual Circuit Holding Times in IP over ATM Networks" Proc. of 
INFOCOM 1994, Y. Afek, M. Cohen, E. Haalman, Y. Mansour, "Dynamic 
Bandwidth Allocation Policies, " 0743-166X/96 IEEE, and S. K. Biswas, R. 
Izmailov, "Design of a fair Bandwidth allocation Policy for VBR Traffic in ATM 
Networks," IEEE/ACM Trans. On Networking, V:8, N:2, April 2000. 

20 

However, if the data rate changes, then the allocated bandwidth may need to be 
changed. Periodic rate adjustment methods measure and adjust the bandwidth at 
fixed time intervals, while adaptive methods attempt to adjust the bandwidth 
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whenever a change is necessary. The adjustment can close the current VC and 
open a new one, or change the bandwidth allocation for the current VC. 

Variable bit rate (VBR) data, e.g., compressed videos, pose a unique challenge 
5 because of rapid fluctuations in the bit rate. Specifically, for VBR video data, 
bandwidth requirements change due to unavoidable coding data structures. For 
example, MPEG uses B-frames, and group of pictures (GOP). Each GOP starts 
with an I-frame followed by a P-frame. B-frames have fewer bits than P- and I- 
frames. Motion activities also cause fluctuations in the bit rate because the number 
10 of bits in the P- and B-frames depend on the amount of motion in the video. 

For VBR data, dynamic resource allocation is crucial, especially for traffic that is 
bursty in time scales from milliseconds to seconds or even minutes. This burstiness 
phenomenon at different time scales is called self-similarity, see M. W. Garrett, W. 

15 Willinger, "Analysis, Modeling, and Generation of Self-similar VBR Video 

Traffic" ACM SIGCOMM, London, 1994. They found a relation between energy 
distribution of a signal in frequency domain and the level of traffic self-similarity. 
However, any analytical study that makes use the link between self-similarity level 
and energy distribution to dynamically allocate network resources has not been 

20 done yet. It is known that increasing level of self-similarity of a traffic trace 

increases the required network resources to prevent QoS degradation, such as delay 
and packet loss rate. Therefore, a correct modeling and prediction of self-similar 
traffic and the quantification of the network resources to allocate in each resource 
renegotiation is non-trivial. 

25 

A number of dynamic bandwidth allocation methods are known, see U.S Patents 
6,118,791 "Adaptive bandwidth allocation method for non-reserved traffic in a 

2 
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high-speed data transmission network, and system for implementing said method" 
5,991,308 "Lower overhead method for data transmission using ATM and SCDMA 
over hybrid fiber coax cable plant," and 5,745,837 "Apparatus and method for 
digital data transmission over a CATV system using an ATM transport protocol 
5 and SCDMA.", also see S. Chong, S. Li, J. Ghosh, "Predictive Dynamic Bandwidth 
Allocation for Efficient Transport of Real Time VBR Video over ATM," IEEE 
Journal on Selected Areas in Comm, V:13, N:l, January 1995, pp. 12-23. 

Typically, a predication is made, and a new allocation is based on the prediction 
10 and previous updates, see Chong, S. Li, J. Ghosh, "Efficient Transport of real time 
VBR Video over ATM via Dynamic Bandwidth Allocation " University Of Texas at 
Austin, Austin, Texas 78712, August 1995. The prediction can consider the 
overall, previous, or average bit rates, and buffer sizes, or combinations thereof. 
Peak-rate based methods result in a minimum number of updates. However, 
1 5 bandwidth is used inefficiently. Methods based on previous and average bit rates 
may not be able to match rapid changes in bit rates, causing delays. 

Predicting exact bandwidth requirements in a network is a difficult problem. 
Clearly, the total bandwidth allocated during a session must at least match the total 
20 amount of data to be transmitted. If less than the required bandwidth is allocated, 
then some of the data must at least be delayed, or possibly irretrievably lost. If 
more than the required bandwidth is allocated, network resources are wasted. 
Therefore, it is desired to accurately predict traffic characteristics, and to 
dynamically allocate matching network resources accordingly. 

25 

Minimization of the number of renegotiations is also an important problem. 
Increasing the frequency of bandwidth renegotiations increases, and accordingly 
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overload the network's signaling components. On the other hand, an inadequate 
number of renegotiations makes it difficult to follow traffic trends, and results in 
inefficient bandwidth utilization. 

5 Setting the inter-negotiation times at fixed intervals (synchronous) is simple but 
not efficient. In asynchronous process, the bandwidth is adapted if and only if the 
demand exceeds a pre-assigned level. Traffic based renegotiation such as that 
introduced in the prior art, see Zhang et al., "RED-VBR: A new approach to 
support delay-sensitive VBR video in packet-switched networks" Proc. 

10 NOSSDAV, pp. 258-272 1995, is asynchronous and is able to capture the near 
future bandwidth demand closely. However, a single very small or large video 
frame might cause high underutilization or over-utilization of the capacity for some 
time. The asynchronous operation can significantly reduce the adaptation 
frequency at the cost of decrease in utilization. 

15 

S. Chong, S. Li, J. Ghosh, "Predictive Dynamic Bandwidth Allocation for Efficient 
Transport of Real Time VBR Video over ATM" IEEE Journal on Selected Areas in 
Comm, V:13, N:l, pp. 12-23, 1995, measures video traffic statistics in the 
frequency domain. They low pass filter the incoming traffic trace to capture the 
20 slow time variation of consecutive scene changes. However, they do not take high 
frequency components into account that can also demand non-negligible 
bandwidth. 

Therefore, there is a need for improved generic method and system to dynamically 
25 allocate network resources to an applications traffic at asynchronously computed 
renegotiation times and with consideration of signal features in different frequency 
sub-bands. 
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Summary of the Invention 

The invention provides a method and system for adaptively allocating bandwidth 
5 for a variable rate traffic stream. More specifically, the invention provides a 
method and system for dynamically allocating network resources for data stream 
traffic in a network by taking into account the traffic features in frequency domain. 

A dynamic mechanism uses wavelet filter banks to split an energy of a data stream 
10 into sub-frequency bands, and measures an energy of a data measuring process at 
an output of dyadic sub-band filters in frequency domain. The measured energy is 
then used to predict short and long term fluctuations in the incoming traffic pattern, 
and to adjust the bandwidth allocation accordingly. Whether a bandwidth 
renegotiation is needed is determined by a controller unit based on the new 
15 bandwidth prediction information and the comparison of mean and variance of the 
sub-band energies in the previous measurement and the current one measurement. 

A method dynamically allocates bandwidth for traffic having a variable data rate in 
a network. A data rate of the traffic received from the network is measured during 
20 fixed length time intervals. 

A predetermine number of consecutive data rates are grouped into overlapping 
vectors. A discrete wavelet transform is applied to each overlapping vector to 
determine frequency bands for each vector, and the frequency bands of each vector 
25 are analyzed to determine an associated energy of the data rate. 
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Then, the bandwidth is allocated to the traffic according to the associated energy 
when the traffic is transmitted. 

Brief Description of the Drawings 

5 

Figure la is a high level block diagram of an adaptive bandwidth allocation 
method and system according to the invention; 

Figure lb is low level block diagram of the adaptive bandwidth allocation method 
10 and system of Figure la; 

Figure 2 is a block diagram of a dyadic tree structure with Haar wavelet filters of a 
discrete wavelet transform block of the system of Figure lb; 

15 Figure 3 is a graph of output of a data counter of the system of Figure lb; 

Figure 4 is a trace of MPEG-4 video frame sizes over time; 

Figure 5 is a partitioned graph of a frequency spectrum; 

20 

Figure 6a is a block diagram of a wavelet transformed data coefficient vector; 
Figure 6b is a block diagram of two adjacent overlapping vectors; 
25 Figure 7 is a block diagram of output from an analyzer; 
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Figure 8 is a block diagram of a resource allocation block of the system of Figure 
lb; 

Figure 9 is a block diagram of the dynamic bandwidth controller block used by the 
5 system of Figure lb; 

Figures 10 and 1 1 are graphs comparing queue size performances; and 

Figure 12 is a graph comparing average queue size and utilization. 

10 

Detailed Description of the Preferred Embodiment 

As shown in Figure la, a system and method 100 according to our invention 
decomposes time series network traffic data arrival rate information 101 into 

15 multiple frequency bands. The frequency bands are used to identify low and high 
frequency components in the data arrival rate. An energy distribution in each 
frequency band is determined in order to analyze 1050 short and long term 
fluctuations in the network traffic. We use the output of the analysis to 
dynamically allocate 800 bandwidth for data streams transmitted by the network 

20 102. 

Our unique energy distribution analysis enables better predictions of the bandwidth 
requirements than prior art techniques. Our method is applicable to both aggregate 
and individual applications traffic. Our method can be used to distribute an 
25 available bandwidth among multiple traffic data streams based on their frequency 
characteristics. More specifically, our invention can be deployed in weighted fair 
queuing (WFQ) processes to adaptively update weight coefficients of each traffic 
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class entering into the WFQ process. Our invention can be used in quality-of- 
service (QoS) management blocks of network routers, switches, digital subscriber 
line access multiplexer (DSLAM), and the like. 

5 Overview of System Structure 

As shown in Figure lb, the system 100 according to our invention includes a clock 
1 10 connected to a data counter 120. The data counter receives the incoming 
network traffic (data) 101. The network traffic is also presented to an output queue 
10 or buffer 105. 

The output of the data counter 120 is connected to a shift register 130 of size M, 
for example eight. The shift register 130 is connected to a discrete wavelet 
transform unit (DWT) 200, e.g., a Haar wavelet filter bank. Specifically, We use a 
15 Haar-2 basis. An analyzer 140 processes the output of the DWT 200. The output of 
the analyzer is connected to resource allocation mechanism (RAM) 800. 

The RAM 800 can also receive optional feedback parameters, e.g., buffer statistics 
801, from the buffer 105 and a minimum non-zero value X D c 132 from 130. The 

20 output 809 from the RAM 800 drives a dynamic bandwidth controller (DBC) 900, 
which in turn, decides whether to start a renegotiation cycle with the network 102 
based on the new prediction information and the comparison of previous and 
current variance and mean of the energy distribution in the sub-bands and sets a 
renegotiation flag. The DBC starts a renegotiation cycle with a network according 

25 to values of the renegotiation flag, e.g. renegotiate if the flag is one. If no 

renegotiation is decided, The DBC waits for the next prediction from the RAM 
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800. The DBC is also responsible for forwarding the buffered traffic onto the 
network 102 at the current negotiated data rates. 

System Operation 

5 

The clock 1 10 sets time intervals ^S(t - nT) , at a clock rate of — . During each 

n T 

time interval, the amount of data (X n ) 121 that is received at QoS management 
block is measured by in the data counter 120. The measured data 121 can be bits, 
bytes, packets, cells, etc. as shown in Figure 7 for a thirty second MPEG-4 video 

10 trace 401 where the x-axis 402 is the index of frames transmitted and the y-axis 
400 is the frame sizes in bits. The amount of data received in a given fixed length 
time interval essentially gives the instantaneous data rate during the interval. The 
most recent M values of the measured data rate are buffered in the shift register 
130 as an integer vector X k =[X(n-M+1) X(n-M+2) ....X(n\ 131 and also the 

15 minimum non-zero sample 132 of the integer vector 131 is determined. 

Figure 3 graphs data arrival rates 301 for consecutive time intervals where each 
vector X has N elements. 

20 In the vector 13 1 , n is a time instance, A: is a time scale, and M is an integer, e.g., 
eight samples. Each element X(i) indicates the amount of data, e.g., bytes, received 
in a time slot L For two consecutive time instances, the arrival rate information can 
be expressed by their sum and their difference. The difference reveals sharp 
changes in the arrival rate. An average arrival rate vector including M consecutive 

25 time slots is 
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X k+1 =\/2.[X(n-M+l)+X(n-M+2) X(n-M+3)+X(n-M+4) 
.... X(n-1) +X(n)] 



(1) 



at a time scale of k+1. 

Difference of the arrivals of data between two consecutive time slots is denoted by 

5 a vector + j such that 

Y k + 1 =l/2.[X(n-M+l)-X(n-M+2) X(n-M+3)-X(n-M+4) ^ 
.... X(n-1) -X(n)] 

Equations 1 and 2 can be rewritten in the general form 



Discrete Wavelet Transform 

We are interested in the dynamic behavior of the traffic as manifested by 
15 differences between consecutive samples. The data measuring steps can produce 
zero and positive integer values. Wavelet domain modeling of positive processes 
requires that a positive output is ensured. To guarantee that a process is positive, a 
sufficient and necessary condition is | Y kn (i) |< Y t> „ (t) . The Haar wavelet satisfies 

this constraint. Therefore, we use the Haar-2 wavelet. However, any wavelet 
20 satisfying the above condition can be used in the DWT block 200. 

Therefore, as shown in Figure 2, we pass the buffered arrival rate vector X k , n 131 
through a dyadic tree of scaling filters 210 and wavelet filters 220, where each 
branch produces a low frequency component X M 211 , and 212, 213 respectively 



X k + 1 © = °- 5 f %-k( 2i-l)+X k ( 2i)) , and 
Xk + 1 ( n ) = °-5( Y k (2i-1)-Y k ( 2i)) . 



(3) 



10 



(4) 
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and a high frequency component X k+ i 221 of X k>n and further 222 and 223. The 
output of each scaling filter 210 is down-sampled 230 by a factor of two. In other 
words, the output of each scaling vector 210 generates pair- wise average arrival 
rate vectors 21 1, 212 and 213, and the output of the each wavelet filter 220 
5 generates pair- wise rate arrival differences 221, 222 and 223. 

The scaling and wavelet coefficient vectors of the Haar wavelet are 9 = [I/V2 1/V2] 

and q> - [I/V2 - 1/V2] , respectively. We know that for \/n,k 9 all X^(n)> 0. As stated 

above, wavelet domain modeling of positive processes requires the constraint that 
10 a positive output is ensured. To guarantee the constraint that the process is positive, 
the sufficient and necessary condition is [Y^ (n)| < X ^ (n) . The provision of this 

constraint for the Haar wavelet is seen by modifying Equations 3 and 4 such that 
X k (2i - 1) = 2" 1/2 (X k + 1 (i) + Y k + ! (i)) , and (5) 



15 



20 



X k (2i) = 2" 1/2 (X k + i(i)-Y k + 1 (i)) . (6) 



The Haar wavelet coefficients of a stationary signal are identically distributed with 
£[Yjfc(»)]=0for V£. Therefore, applying the discrete Haar wavelet transform 200 on 

the measured arrival rate data 131 reveals irregularities and sharp changes in traffic 
behavior. 

Having R as a MxM wavelet transform matrix composed of parameters of vectors ((> 
and (p, and X as the vector data with length Af, the wavelet transform operation can 
be expressed as W=X.R, where W is the wavelet transform vector with size M. 
DWT block outputs vector W 600 



25 
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Energy of a stochastic process X at scale k can be determined from W 600 by 
2 k , 

E k = S |W(n)| z , k: scale index. (7) 
n = 2 k ~ 1 +l 

Multi-Resolution Energy Distribution Analysis 

5 

Energy distribution in multi-resolution analysis provides information about the 
level of traffic burstiness and self-similarity. Therefore, consideration of energy 
contents of a signal at different time scales in the dynamic bandwidth allocation 
method according to the invention has strong advantage over prior methods to 
1 0 prevent the impacts of traffic self-similarity. 



We define two moving windows: a "data unit" and a u wavelet unit." A moving 
data unit 650 illustrated in Figure 6b, covers eight most recent measured data 
arrival rate samples 131 to be analyzed. Each window of samples X 650 overlaps a 
15 previous window as shown in Figure 6b between two consecutive measurements. 
In Figure 6a, our wavelet transformed data vector W 600 uses a window of eight 
samples, the same size as of "the data unit" so that our multi-resolution process can 
respond to sudden changes in data rates. The area covered by this window is 
denoted as a "wavelet unit," WU. We use the wavelet unit 

20 W = RX =[wwww ^ww^w'w^] 

12345678 

600 to represent the transformed data. 

The analyzer 140 takes the vector W 600 produced by the DWT 200 as input, and 
then computes and forwards the energy information 141 in each sub-band to the 
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RAM 800. Energy of the stochastic process X at scale k in the dyadic tree is 
determined by Equation 7, and yields energy vector E n [E hn ,[E 2n ,...,[E k ,J 141. 

As shown in Figure 5, energy 501 in each scale 510-513 is found by applying 
5 Equation 7 to the wavelet transform unit vector W 600. The x-axis 502 is in units 
of radians. Scale 513 reveals the highest frequency detail within the original traffic 
data. The detail is expressed by four coefficients. The detail in scale index 512 is 
assigned to two coefficients. The first two element 511 and 510 in vector W 600 
stands are assigned one element of coarser scales. 

10 

The sum of the energies in each frequency band is bounded by the total energy of 
original data X Strong empirical evidence contends that the wavelet coefficients 
from 1/f processes are weakly correlated both along and across the scales. 
Abry et al., in "Wavelet Analysis of Long Range Dependent Traffic'' IEEE Trans. 
15 Inform. Theory, V:44, pp. 2-15, Jan. 1998, and Sahinoglu et al., in "Self- similarity 
and Its Effects on Network Performance" IEEE Comm. Magazine, January 1999, 
describe that for the Haar wavelet, the variance progression of the wavelet 
transform of fractional Gaussian noise satisfies var(W^ (n)) 2~* (2ff-1) . The ratio 
of the energies in two subsequent scales can then be related to the Hurst parameter 
var(W(rc)) 

20 H as y = £ = 2 lti - 1 , see R. Riedi, M. S. Crouse, V. J. Ribeiro, R. G. 

var(W^ + 1 (n)) 

Baraniuk, "A Multifractal Wavelet Model with application to Network Traffic 
IEEE Trans. On Information Theory, V:45, N:3, April 1999. The stability of the 
arrival rate is proportionally related to the increase in this ratio. 
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Resource Allocation Mechanism (RAM) 

We define and use the following properties of frequency and energy distribution in 
the RAM 800. 

5 

Property-I 

If for Vij, X(i)=X(j) where 0<iJ<N, i^j and ij eZ\ the energy content in each 
high frequency band becomes zero, and traffic is considered to be constant bit rate 
10 (CBR). In this case the entire energy of the input data is present within the lowest 
frequency band. The bandwidth to allocate to this type of traffic must be equal to 
X(i). 

Property-II 

15 If the elements of X show an increasing characteristic over time such that 

X(n) > X(n - 1) n=2,3 N, then the energy distribution in each frequency band 
increases from finest to a coarser scale, being the lowest in the highest frequency 
region, %Ej-a]>W?j]. The RAM unit increases the bandwidth demand for the next 
time slot and sends this request to the DBC 900. 

20 
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Property-Ill 

A decrease in the coarse scale energy while the fine scale energies are stable is an 
indicator of a linear decrease in traffic volume. Less bandwidth than that in the 
5 previous time slot is needed. A request to lower the bandwidth allocation is sent to 
DBC from RAM. 

Property-IV 

10 Assume that V/ stands for the variance of the energies among k scales in time slot /, 
Mi stands for the mean value of energy contents, and Ui stands for the utilization. 

Therefore, the following statements hold. 

15 V M >Vi and M i+1 <Mi ^U i+1 <Ui 

This is representative of possibly approaching "OFF" interval, or departing flows 
in case of aggregate traffic. The request to decrease the bandwidth allocation is 
sent to the DBC. 

20 V i+I >Vi and M M >M { =>U i+1 >Ui 

This is representative of added flows to the aggregate traffic or an approaching 
"ON" interval. The request to increase the bandwidth allocation is sent to the DBC. 

V i+I <Vi and M M <M t =>U i+I <Ui 
25 This is representative of traffic is getting smoother. In this case no bandwidth 
renegotiation is required. 
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V i+I <Vi and M i+; >Mf =>U M <U t 
This is representative of traffic getting smoother with increased utilization 
Therefore, the request for increase in bandwidth is sent to the DBC 

5 

After receiving a request for bandwidth renegotiation and the amount of bandwidth 
to allocate in the next time slot, the DBC 900 uses a threshold table that comprises 
the previous energy statistics and decides whether to grant the request, or not. 

10 Figure 8 shows the RAM 800 that receives the energy vector 141 from the 

analyzer. The RAM also receives external feedback parameters (buffer statistics) 
801, e.g., momentary buffer size, packet/cell loss rate, and the minimum non-zero 
value X D c 132 of the integer vector 131 produced by the shift register 130. 

15 Figure 9 shows the dynamic bandwidth controller unit 900 which takes the 
variance and mean of the energy distribution in previous measure 902 and the 
current measure 903, and the new bandwidth prediction 809 from RAM 800 and 
decides if to start a resource renegotiation cycle with the network. 

20 System Details 

The system first filters out the minimum non-zero DC component X D c 132 in 
traffic measurements X 131. Effectively, the X DC 132 is a lower bound for the 
bandwidth allocation in a next time slot and is one of the contributing components 
25 in each bandwidth prediction. The signal 131 at the output of the M shift register 
130 includes low and high frequency components. The signal 131 is fed into a 
filter bank in which high pass filters 220 are composed of Haar wavelet 
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coefficients, and low pass filters 210 are composed of Haar wavelet scaling 
coefficients. The signal 131 is decomposed into three high frequency sub-bands 
511-513, a coarse sub-band 510, as described above. Energies in each of the high 
frequency sub-band 51 1-513 are used as a representative of the traffic volume 
5 within that frequency band. 

The traffic volume that generates the maximum energy E max 804 is computed. 
Because underestimation may cause the buffer congestion, while overestimation 
can only result in underutilization of the available bandwidth, we take the 

10 contribution of maximum energy content in each adaptation interval for the 

bandwidth allocation. The square root 802 of E max 804 returns a signal that would 
have the energy amount E max 804. This equivalent signal, the square root of E max is 
added to 132 by 803 as the second component to the new bandwidth prediction. 
The new prediction is also compensated with the present queue size 801 to flush 

15 the queue contents to prevent building up delays. 

Finally, the new prediction 809 takes the form in Eq.8 

B W(n + 1) = X DC (n) + max£? n (/)) + queue__ sizdji) ( 8 ) 

20 We can also modify the RAM 600 so that the buffer size information 801 is not 
needed for bandwidth renegotiation. This can be done without degrading the 
queuing performance and without increasing the capacity underutilization. 

In a first modification, the RAM 600 method compensates the new bandwidth 
25 allocation by including a component with energy equivalent to the superposition of 
all the energies 
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K 
i-1 

Here, the value K is the number of high frequency sub-bands into which the data 
are decomposed. 

5 In a second modification, the bandwidth compensation is provided as the sum of K 
components, each of which is representing a bandwidth contribution such that the 
energy of each component is the same as the energy in one of the sub-bands. 



h=i 

Each sub-band is represented only by a single component. 



10 



A third modification, Eq.ll, determines the new prediction as 

K 



BW(n+l)=W„a) + lV&®. 

i=l 



I M 

where W n (1) = X n (0 > that is the average of a data unit X kn 131, or in 

15 other words the first element in W 600. 



A fourth modification, determines 



5^+i)=w„(i) +1 |i^(o. 
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The condition W n (1) > X DC n in time slot n is always true. Therefore, it is clear 

that the third and fourth modifications allocate more bandwidth in each 
renegotiation than the first and second modifications. 

5 Figure 10 compares the queuing performances, of the wavelet-energy method 
according to the invention with four traditonal approaches. 

Figure 1 1 compares the queuing performances 1 101-1 104, in a top to bottom order, 
of the four modified wavelet-energy methods described above where the x-axis 
10 1 105 is the index of a time slot, and the y-axis 1 100 is the average queue size. 

Figure 12 compares the trade between average utilization 1201 and average queue 
size 1202 for the four modified wavelet-energy RAM methods where the x-axis 
1 103 is the index of a time slot, and the y-axis to the left 1200 is average utilization 
15 and y-axis to the right is average queue size. 

Predicting bandwidth requirements using the wavelet-energy method as described 
above yields better performs than prior art techniques. The invention also enables 
smaller queue sizes at a minimal expense of increased bandwidth utilization. 

20 

This invention is described using specific terms and examples. It is to be 
understood that various other adaptations and modifications may be made within 
the spirit and scope of the invention. Therefore, it is the object of the appended 
claims to cover all such variations and modifications as come within the true spirit 
25 and scope of the invention. 
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